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Abstract 

Optimal  design  methods  (designed  to  choose  optimal  sampling  distributions  through  mini¬ 
mization  of  a  specific  cost  function  related  to  the  resulting  error  in  parameter  estimates)  for 
inverse  or  parameter  estimation  problems  are  considered.  We  compare  a  recent  design  criteria, 
SID-optimal  design  ( standard  error  optimal  design  [8])  with  the  more  traditional  ID-optimal  and 
ID-optimal  designs.  The  optimal  sampling  distributions  from  each  design  are  used  to  compute  and 
compare  standard  errors;  here  the  standard  errors  for  parameters  are  computed  using  the  opti¬ 
mal  mesh  along  with  Monte  Carlo  simulations  as  compared  to  asymptotic  theory  based  standard 
errors.  We  illustrate  ideas  with  two  examples:  the  Verhulst-Pearl  logistic  population  model  [10] 
and  the  standard  harmonic  oscillator  model  [10]. 
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1  Introduction 


In  recent  years  modeling  in  the  life  sciences  involves  increasingly  sophisticated  models  with  a  plethora 
of  parameters  to  be  estimated.  This  is  due  in  part  to  increasingly  stringent  requirements  concerning 
accuracy  and  the  desire  for  adaptation  of  models  to  individual  subjects.  In  contrast  to  this  complex 
situation  one  usually  is  confronted  with  serious  restrictions  on  data  which  often  need  to  be  obtained 
by  noninvasive  or  modestly  invasive  procedures.  The  validation  of  such  models  is,  as  a  result,  a 
very  challenging  problem.  It  is  therefore  necessary  to  design  the  data  collection  procedures  very 
carefully  in  order  to  optimize  the  information  content  carried  by  the  data  obtained.  Methods  of 
optimal  experimental  design  are  of  central  importance  in  this  context  and  have  justifiably  received 
significant  attention  in  the  research  literature  (see  for  example  [11,  14,  15,  22]).  Since  one  has 
a  number  of  different  design  criteria  from  which  to  choose,  it  is  important  to  have  procedures  to 
compare  typical  results  obtained  by  using  different  criteria.  A  natural  criterion  for  comparison  of 
different  approaches  are  the  standard  errors  of  the  parameters  estimated  on  the  basis  of  the  data 
provided  by  the  optimally  designed  experiments.  One  possibility  which  has  been  frequently  employed 
is  the  asymptotic  approximation  of  standard  errors  [23]  which  are  based  on  only  a  single  realization 
and  the  limiting  approximations.  However,  such  standard  errors  obtained  in  specific  cases  may  not 
be  sufficiently  precise,  because  the  underlying  assumptions  for  these  asymptotic  approximations  may 
not  be  satisfied.  Therefore  it  is  of  interest  to  use  a  different  approach  which  is  not  based  on  a 
single  realization  of  the  observation  process,  but  uses  a  large  number  of  realizations,  with,  of  course, 
increased  computational  costs.  To  illustrate  an  alternative  approach,  we  present  in  this  paper  a 
detailed  Monte  Carlo  analysis  of  the  performance  of  several  optimal  design  methods  for  the  logistic 
and  harmonic  oscillator  examples  which  were  previously  [8]  investigated  using  asymptotic  standard 
errors  as  a  measure  of  comparison. 


2  Optimal  design  of  sampling  times 

Given  the  duration  or  time  interval  [0,  T ]  for  an  experiment  and  the  number  N  of  the  sampling 
times  allowed,  the  remaining  fundamental  question  of  optimal  experimental  design  to  be  answered 
is  the  location  of  the  sampling  times  in  [0,T],  In  [7]  a  general  theoretical  framework  for  optimal 
experimental  design  problems  has  been  developed,  which  incorporates  all  design  criteria  based  on 
the  Fisher  Information  Matrix  (FIM)  (see  (2.6)  below  for  a  definition  of  the  FIM  in  case  of  discrete 
sampling  times)  for  the  given  parameter  estimation  problem.  This  general  theoretical  framework  is 
based  on  abstract  sampling  distributions  which  can  be  represented  using  probability  measures  on 
the  Borel  subsets  of  [0,  T],  which  typically  cannot  be  realized  by  concrete  measurement  procedures. 
However,  this  general  approach  provides  an  abstract  setting  for  existence  and  approximation  results 
based  on  the  fact  that  the  space  V(0,  T)  of  probability  measures  on  [0,  T]  supplied  with  the  Prohorov 
metric  (see  [2,  12,  16,  21])  is  a  compact  and  separable  metric  space  (see  [7,  Section  4]).  In  particular, 
this  theory  permits  development  of  computational  methods  using  discrete  measures  with  a  finite 
number  of  atoms,  which  are  precisely  those  corresponding  to  sampling  procedures  which  can  be 
realized.  In  the  following  we  present  the  results  only  for  this  case  and  refer  for  the  general  theory  to 

[bl¬ 
under  lying  our  considerations  is  a  mathematical  output  model 

V(t)  =  t  G  [0,T],  9  e  A,  (2.1) 

where  rj(t )  G  M  is  the  scalar  measurable  or  observable  output  of  the  system,  /  :  [0,  T]  x  A  — >  M 
is  a  sufficiently  smooth  mapping,  9  G  is  the  vector  of  system  parameters,  A  C  is  the  set  of 
admissible  parameter  vectors  and  T  is  the  endpoint  of  the  observation  interval. 
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To  consider  measures  of  uncertainty  in  estimated  parameters,  one  also  requires  a  statistical  model 
[4],  Our  statistical  model  is  given  by  the  stochastic  observation  process 

Y(t)  =  f(t,0o)  +  £(t),  t  €  [0, T\.  (2.2) 

Here  £  is  a  stochastic  process  representing  measurement  errors  and,  as  usual  in  statistical  formu¬ 
lations  [4,  7,  13,  23],  0o  is  the  vector  of  the  hypothesized  “true”  or  nominal  values  of  the  unknown 
parameters.  We  make  the  following  standard  assumptions  on  the  random  variables  £(t): 

E(£(£))  =  0,  t.  £  [0,T], 

Var £(t)  =  <x(t)2/,  t  €  [0,T],  (2.3) 

Cov(£(t)£(s))  =  a (t)2Id(t  —  s),  t,  s  G  [0,  T], 

where  5(s)  =  1  for  s  =  0  and  5(s)  =  0  for  s  0.  A  realization  of  the  observation  process  is  given  by 

y(t)  =  /(Mo)  +  e(t),  te[0,T], 

where  y(t )  is  a  concrete  measurement  for  rj(t )  at  time  t  and  the  measurement  error  eft)  is  a  realization 
of  £{t). 

The  statistical  model  we  assume  is  a  classical  first  model  widely  found  in  regression  analysis  [13,  23] 
and  is  often  employed  in  development  of  ideas  (asymptotic  distribution  theory,  statistical  comparison 
tests,  etc.)  as  well  as  in  certain  applications.  Two  (the  second  and  third)  of  the  assumptions  (2.3)  are 
sometimes  violated  in  repeated  measurement  data  problems,  especially  in  economic  data  and  in  bio¬ 
logical  data  with  high  frequency  sampling  using  model  response  dependent  assays.  The  assumptions 
of  independence  and  zero  correlation  for  the  statistical  model  can  often  be  checked/supported  via 
residual  plots  [4,  10,  13,  23]  (after  carrying  out  the  inverse  or  regression  problem  fits  with  ordinary 
least  squares).  More  sophisticated  error  models  (e.g.,  nonconstant  variance,  nontrivial  correlation) 
might  also  require  different  inverse  problem  formulations  [4]  (e.g.,  generalized  least  squares  or  maxi¬ 
mum  likelihood  if  sufficient  information  is  known  about  the  distributions  of  errors) .  Our  choice  of  this 
simple  statistical  model  was  motivated  primarily  for  two  reasons:  (i)  it  is  simple,  widely  known/used 
and  easy  to  use  in  comparison  of  designs,  and  (ii)  our  own  efforts  (e.g.,  see  [3,  5,  6,  9,  10]  and  the 
references  therein)  in  numerous  inverse  problems  with  longitudinal  data  for  HIV  patients,  data  for 
insect  and  marine  populations,  and  vibrational  engineering  data  often  have  dealt  with  data  in  which 
independence  of  sampling  appeared  to  be  reasonable.  Even  when  correlation  might  be  present,  it 
is  often  assumed  fast  decaying  with  respect  to  distance/time  between  observations  (this  is  a  stan¬ 
dard  correlation  model-see  [13,  23])  and  independence  is  a  reasonable  assumption  for  low  frequency 
sampling  times.  However,  there  are  numerous  situations  in  practice  where  independence  is  readily 
violated  (e.g.,  economics  and  biology)  and  techniques  in  the  presence  of  nontrivial  data  correlations 
are  an  active  area  of  optimal  design  research  (see  [19,  20,  24]  and  the  references  therein). 

For  sampling  points  r  =  H  <  •  •  •  <  tjv  in  [0,T],  we  introduce  the  weighted  least  squares 

criterion 

N  1 

J (2/,  0)  =  EihjW  -  /&>  0))2>  6  G  A-  ( 2A ) 

*=i 

We  seek  the  parameter  estimate  9  by  minimizing  J(y,  9)  for  9  G  A, 

9  =  argmin  J(y,  9).  (2.5) 

e&A 

Of  central  importance  for  our  discussions  is  the  Fisher  Information  Matrix  (FIM), 

N  1 

F(t,  90)  =  Y,  -^^/(fj,  90)TVef(tj,  90),  (2.6) 

j=l  a  Oil 
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where  \7g  is  a  row  vector  given  by  (dg1, . . . ,  dg  )  and  hence  Vgf(tj ,  6)  \g=g0,  the  gradient  of  /  with 
respect  to  9,  is  a  row  vector  of  length  p. 

The  estimate  9  obtained  in  (2.5)  for  a  specific  set  of  measurements  is  a  representation  of  a  random 
variable  0  =  0(r,  Qo),  the  least  squares  estimator  for  our  parameter  estimation  problem.  We  are 
interested  in  the  statistical  properties  of  0.  Using  linearization  of  /(f ,  9)  around  9q  and  asymptotic 
results  of  statistical  analysis  for  least  squares  estimation  we  obtain  that  (see  [7,  Appendix]) 

E(0)  «  0O, 

Cov(0)  «  F(t ,  0O)_1. 

As  a  consequence  we  have  the  following  asymptotic  standard  errors  for  the  components  of  the  estimate 
9  obtained  in  (2.5): 

SE(9k)  =  ^/{F(T,90)-i)kk ,  k  =  l,...pp.  (2.7) 

The  major  question  in  optimal  design  of  experiments  which  we  consider  in  this  paper  is  how  to  best 
choose  r  =  €  T,  where  T  is  the  set  of  all  time  meshes  such  that  0  <  t\  <  ■  ■  ■  <  ti  < 

U+i  <  •  •  •  <  tjy  <  T.  In  order  to  characterize  “best”  we  have  to  use  a  design  criterion.  In  order  to 
define  such  design  criteria  we  observe  that  the  FIM  F(t,  9q)  depends  critically  on  the  sampling  mesh 
r.  Let  a  continuous  functional  J  :  MPxp  — >  M+  be  given.  The  optimal  design  problem  associated 
with  J  is  the  one  of  finding  a  sampling  mesh  r*  G  T  such  that 

J{F(t*,60))  =mmj(F(T,eQ)).  (2.8) 

tET 

The  mapping  t  ->  J  ( F(t ,  0o))  is  the  design  criterion  used  for  the  design  problem. 

The  formulation  (2.8)  incorporates  all  optimal  design  methods  which  are  based  on  minimizing  or 
maximizing  a  functional  depending  continuously  ou  the  Fisher  Information  Matrix.  In  this  paper 
we  compare  the  results  obtained  with  the  following  optimal  design  methods:  S'F-optimal  design  as 
introduced  in  [7],  D-optimal  design  and  F-optimal  design.  The  design  cost  functional  J  for  the 
S'F-optimal  design  method  (see  [7])  is  given  by 

=  P'9> 

i= 1 

where  F  =  F(t,9q)  is  the  FIM  defined  above  in  (2.6),  9q  is  the  true  parameter  vector,  and  p  is  the 
number  of  parameters  to  be  estimated.  Note  that  both  inversion  and  taking  the  trace  of  a  matrix 
are  continuous  operations.  We  observe  that  F(r,9 o)^1  =  SE(9i)2.  Therefore,  5F-optimal  design 
minimizes  the  sum  of  squared  normalized  asymptotic  standard  errors. 

H-optinral  design  minimizes  the  volume  of  the  confidence  ellipsoid  for  the  asymptotic  covariance 
matrix  F(t,0q)~1  .  The  design  cost  functional  for  ID-optimal  design  (see  [11,  15])  is  given  by 

Jd{F)  =  det  F-1.  (2.10) 

Again  we  note  that  taking  the  determinant  is  a  continuous  operation  on  matrices  so  that  Jn  is 
continuous  in  F  as  required  by  the  theory. 

F-optimal  design  minimizes  the  principle  axis  of  the  confidence  ellipsoid  of  the  covariance  matrix 
(defined  in  the  asymptotic  theory  summarized  in  the  next  section).  The  design  cost  functional  for 
F-optimal  design  (see  [1,  11])  is  given  by 

Je(F)  =  max-*-,  (2.11) 

*  A* 

where  A  j,  i  =  1 . .  .p,  are  the  eigenvalues  of  F  (which  are  continuous  functions  of  F ).  Consequently 
p,  i  =  1, . . .  ,p,  are  the  eigenvalues  of  the  asymptotic  covariance  matrix  F(t,  $o)-1- 
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2.1  Constrained  optimization  and  implementations 

Each  optimal  design  computational  method  we  employ  is  based  on  constrained  optimization  to  find 
the  mesh  of  time  points  r*  =  {t*},  i  =  1, . . . ,  N,  that  satisfy 

J(F(t*,60))  =  min  j(F(T,e0)), 

t£T 

where  T  is  the  set  of  all  time  meshes  such  that  0  <  t\  <  •  •  •  <  ti  <  tt+\  <  ■  ■  ■  <  <  T. 

These  optimal  design  methods  were  implemented  using  constrained  optimization  algorithms,  either 
MATLAB’s  fmincon  or  SolvOpt,  developed  by  A.  Kuntsevich  and  F.  Kappel  [18,  17],  with  four 
variations  of  the  constraint  implementation.  We  denote  by  (Cl)  -  (C4)  these  different  constraint 
implementations  (which  most  often  do  result  in  different  parameter  and  standard  error  outcomes 
even  in  cases  where  the  {U}i=i  n  are  initially  required  to  satisfy  similar  constraints).  Complete 
details  of  the  precise  implementation  differences  in  the  algorithms  are  given  in  the  appendix  of  [8]. 
We  briefly  summarize  these  here. 

(Cl)  In  this  case  we  impose  the  inequality  constraints 

0  <  ti  <  ■  ■  ■  <  U  <  ti+ 1  <■■■  <tN  <T, 

i.e.,  the  optimal  mesh  may  or  may  not  contain  0  and  T.  In  this  case  we  optimize  over  N 
variables. 

(C2)  In  this  case  we  fix  t±  =  0,  tw  =  T  and  impose  the  inequality  constraints 

0  <  t2  <  •  •  •  <  ijv-i  <  T, 

i.e.,  the  optimal  mesh  contains  0  and  T.  Hence  we  optimize  over  N  —  2  variables. 

(C3)  We  also  fix  t\  =  0,  ijv  =  T  and  represent  the  other  mesh  points  by  U  =  ti-i+Ui,  i  =  2, . . . ,  N—  1. 
For  i/j,  i  =  2, . . . ,  N  —  1  we  impose  the  inequality  constraints 

Vi  >  0,  i  =  2, . . . ,  N  —  1,  and  V2  +  ■  ■  ■  +  z^n-i  <  T. 

Note  that  the  optimal  mesh  always  contains  0  and  T  as  we  optimize  over  N  —  2  variables. 

(C4)  We  fix  ti  =  0  and,  as  in  case  (C3),  represent  the  other  sampling  times  by  ti  =  ti- 1  +  vt, 
i  =  2, . . . ,  N.  For  z^,  i  =  2, . . . ,  N,  we  impose  the  constraints 

Vi  >  0,  i  =  2, . . . ,  N,  and  T  =  V2  +  ■  ■  ■  +  vjy. 

The  equality  constraint  can  be  also  written  as  vjy  =  T  —  vi-  optimal  mesh  again 

contains  0  and  T,  and  we  optimize  over  N  —  1  variables.  Note  that  in  view  of  the  equality 
constraint  and  the  definition  of  the  Vi  we  have  tzv  =  V2  +  •  •  •  +  v^  =  T. 


3  Monte  Carlo  methodology 

For  a  single  Monte  Carlo  trial,  we  generate  simulated  data  on  the  optimal  mesh  r*  =  {tj}j= 
based  on  the  true  parameter  vector  do  corresponding  to  our  statistical  model 

Vj  =  +  €j,  j  =  l,...,N, 


5 


where  the  ej  are  realizations  of  Sj  ~  A7(0,  ctq)  for  j  =  1, . . . ,  N.  Parameters  are  estimated  using  OLS 
taking  the  initial  parameter  guess  to  be  9 0  =  1.4#o-  The  parameter  estimates  6  are  stored,  and  the 
process  is  repeated  with  new  simulated  data  corresponding  to  the  optimal  mesh  for  M  Monte  Carlo 
trials.  For  the  concrete  examples  considered  in  Sections  4  and  5  we  always  take 

M  =  1000. 

More  trials  increase  the  resolution  though  the  results  remain  unchanged. 

In  addition,  for  each  simulated  data  set  we  computed  the  estimated  Fisher  Information  Matrix  (FIM) 
F  =  F(t*,9),  to  determine  if  the  95%  confidence  ellipsoid  contains  the  true  parameter  values  9q. 
The  95%  confidence  ellipsoid  [23]  corresponding  to  normally  distributed  residuals  is  defined  by 

(6-6)JF(e-6)=pFln_p, 

where  F“n_p  is  the  F-distribution  with  p  numerator  degrees  of  freedom,  n—p  denominator  degrees  of 
freedom,  and  critical  level  a  =  0.05.  The  confidence  ellipsoid  will  contain  the  true  parameter  vector 
9q  if  the  following  inequality  holds: 


(< 90-e)JF(e0-e )  <PF«n_p. 


(3.1) 


The  Monte  Carlo  analysis  was  carried  out  for  the  three  different  optimal  design  methods  (S ^-optimal, 
-D-Optimal  and  E-optimal)  as  well  as  for  the  uniform  mesh,  each  time  with  M  new  sets  of  simulated 
data.  For  each  Monte  Carlo  analysis,  the  average  parameter  estimate  0avg  is  reported  along  with 
its  standard  deviation  9sd ■  We  also  will  compare  the  standard  deviations  6*sd  of  these  Monte  Carlo 
trials  to  the  asymptotic  standard  errors  SE(8 )  as  computed  using  asymptotic  theory  in  (2.7). 

In  addition,  we  report  the  proportion  P  of  confidence  ellipsoids  containing  the  true  vector  0q  and 
the  corresponding  standard  error  SE(P), 


P  = 


#  of  95%  confidence  ellipsoids  containing  9q 
M  ! 


SE(P )  = 


'P(l-P) 
M  ' 


(3.2) 


Note  that  P  is  the  estimate  of  Po  the  true  proportion.  Figure  1  gives  an  example  of  95%  confidence 
ellipsoids  corresponding  to  parameter  estimates  for  given  simulated  data.  The  true  parameter  vector 
is  plotted  as  a  point  in  Mp  =  M2.  Ellipsoids  that  contain  the  true  parameter  vector  are  gray  and 
those  that  do  not  are  black,  as  determined  by  the  inequality  given  in  (3.1).  We  are  interested  to 
see  if  P  is  close  to  0.95  (95%  confidence  ellipsoid)  for  the  different  optimal  design  methods  and  the 
uniform  mesh. 
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95%  Confidence  Ellipsoids 


Figure  1:  A  generic  example  of  95%  confidence  ellipsoids  (from  M  =  30  simulated  data  sets,  esti¬ 
mating  p  =  2  parameters),  where  the  true  value  is  given  by  the  star.  Confidence  ellipsoids  containing 
the  true  value  are  gray,  and  confidence  ellipsoids  not  containing  the  true  value  are  black. 


4  Results  for  the  logistic  equation 

4.1  The  Verhulst-Pearl  logistic  population  model 


The  widely  used  logistic  population  model  describes  the  growth  of  a  population  in  an  environment 
with  a  finite  carrying  capacity  for  the  population.  It  is  given  by  the  differential  equation: 


x(t)  =  rx(t)(  1  —  x{t)/K ),  t(0)  =  xq, 


(4.1) 


K 


t  >  0, 


where  K  is  the  carrying  capacity  of  the  environment  for  the  population,  r  is  the  intrinsic  growth 
rate,  and  To  is  the  initial  population  size.  The  analytical  solution  to  this  initial  value  problem  is 
given  by 

x(t)  =  x(t,0)  =  - ,  ,  ... 

W  V  '  1  +  [K/xq  —  l)e“rt 

where  6  =  ( K ,  r,  to)t  is  the  vector  of  system  parameters. 

For  the  statistical  model  in  this  case  we  choose 

f(t,0)  =  x(t,6),  t>  0. 

In  all  our  simulations  we  took  the  nominal  parameter  vector  8q  and  the  length  T  of  the  sampling 
interval  to  be 

Oo  =  (iFnom,  rnom,  T0,nom)T  =  (l7.5,  0.7, 0.l)T,  T  =  25.  (4.2) 


4.2  Monte  Carlo  analysis  for  the  logistic  equation 

Monte  Carlo  analysis  was  performed  using  the  optimal  design  points  found  using  constraint  imple¬ 
mentation  (C2)  and  SolvOpt  with  N  =  10  or  N  =  15  (see  Figure  2).  The  nominal  parameter  vector 
9q  and  T  are  always  given  by  (4.2).  The  Monte  Carlo  analysis  was  conducted  three  times  for  each 
optimal  design  mesh  taking  different  levels  of  constant  variance  ( a2(t )  =  Oq  for  all  t)  noise  in  the 
simulated  data, 

a l  =  0.01,  0.05  or  0.1. 
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Tables  1-3  and  5-7  contain  the  average  estimates  and  standard  deviations  obtained  from  the  Monte 
Carlo  trials  for  N  =  10  and  N  =  15  respectively  and  for  the  three  different  noise  levels.  In  addition, 
the  tables  show  the  asymptotic  standard  errors,  obtained  from  (2.7)  using  the  true  parameter  values, 
for  comparison  with  the  standard  deviations  of  the  Monte  Carlo  parameter  estimates.  The  percentage 
of  95%  confidence  ellipsoids  which  contain  the  true  parameter  vector  and  the  corresponding  standard 
errors  as  given  by  (3.2)  are  shown  in  Tables  4  and  8.  Histograms  of  the  parameter  estimates  are 
plotted  in  Figures  3-5  for  N  =  10  and  Figures  6-8  for  N  =  15.  Each  figure  corresponds  to  a  specific 
value  of  <7q.  Subfigures  represent  histograms  for  different  parameter  estimates,  0  =  (K,r,x o)T. 
Within  each  subfigure  there  are  histograms  for  a  specific  parameter  originating  from  an  optimal 
design  mesh  or  the  uniform  mesh. 


Distribution  of  time  points 


Distribution  of  time  points 


Figure  2:  Optimal  sampling  times  according  to  the  optimal  design  criteria  and  uniform  sampling 
times  plotted  on  the  logistic  curve.  Optimal  sampling  times  were  obtained  using  SolvOpt  with  N  =  10 
(left  panel),  N  =  15  (right  panel),  and  the  constraint  implementation  (C2). 


Table  1:  Average  estimates  0avg  and  corresponding  standard  deviations  #sd  from 
M  =  1000  Monte  Carlo  trials  as  well  as  asymptotic  standard  errors  SE(6). 


N  =  10,  <rg  =  0.01 

SE- opt 

/4-opt 

E-opt 

Uniform 

K 

1  vavg 

17.5019 

17.5015 

17.5013 

17.5003 

AIsd 

4.527  x  10-2 

4.378  x  10"2 

3.495  x  10”2 

4.354  x  10-2 

SE(K) 

4.466  x  10-2 

4.534  x  10"2 

3.535  x  10~2 

4.266  x  10-2 

favg 

0.7003 

0.7004 

0.7004 

0.6995 

rSD 

8.560  x  10“3 

9.341  x  10“3 

2.247  x  10"2 

1.198  x  10~2 

SE(f) 

7.167  x  10-3 

7.673  x  10-3 

1.928  x  10"2 

1.005  x  10”2 

«^0,avg 

0.1000 

0.1000 

0.1009 

0.1007 

£o,SD 

6.087  x  10"3 

7.058  x  10~3 

1.577  x  10~2 

8.944  x  10”3 

SE{x  0) 

4.297  x  10-3 

4.965  x  10~3 

9.996  x  10"3 

6.194  x  10”3 

Table  2:  Average  estimates  0avg  and  corresponding  standard  deviations  #sd  from 
M  =  1000  Monte  Carlo  trials  as  well  as  asymptotic  standard  errors  SE(0). 


N  =  10,  <rg  =  0.05 

SE-opt 

D-opt 

U-opt 

Uniform 

K 

1  Yavg 

17.5009 

17.4979 

17.5021 

17.5059 

A'sd 

1.022  x  10_1 

1.027  x  10”1 

8.133  x  10"2 

9.990  x  10~2 

SE(K) 

9.987  x  10-2 

1.014  x  10_1 

7.906  x  10“2 

9.540  x  10”2 

favg 

0.7002 

0.7005 

0.7028 

0.7007 

fsD 

1.895  x  10"2 

2.091  x  10~2 

5.290  x  10~2 

2.748  x  10”2 

SE(f) 

1.603  x  10-2 

1.716  x  10~2 

4.312  x  10~2 

2.248  x  10"2 

«^0,avg 

0.1007 

0.1009 

0.1044 

0.1017 

^0,SD 

1.334  x  10“2 

1.607  x  10~2 

3.612  x  10”2 

2.025  x  10-2 

SE(x  0) 

9.608  x  10-3 

1.110  x  10-2 

2.235  x  10~2 

1.385  x  10~2 

Table  3:  Average  estimates  9avg  and  corresponding  standard  deviations  $sd  from 
M  =  1000  Monte  Carlo  trials  as  well  as  asymptotic  standard  errors  SE(9). 


N  =  10,  cr2  =  0.1 

SE-  opt 

/4-opt 

A-opt 

Uniform 

K 

^vavg 

17.5037 

17.4942 

17.4912 

17.5067 

A'sd 

1.390  x  10"1 

1.449  x  10”1 

1.069  x  10_1 

1.369  x  10”1 

SE{K) 

1.412  x  10_1 

1.4339  x  10-1 

1.118  x  10_1 

1.349  x  10_1 

favg 

0.7004 

0.7008 

0.7079 

0.7015 

f'SD 

2.756  x  10“2 

3.140  x  10“2 

7.641  x  10“2 

3.882  x  10“2 

SE(r ) 

2.266  x  10“2 

2.426  x  10“2 

6.098  x  10"2 

3.179  x  10-2 

^0,avg 

0.1015 

0.1023 

0.1072 

0.1028 

^0,SD 

1.926  x  10"2 

2.441  x  10~2 

5.158  x  10"2 

2.832  x  10“2 

SE(x  0) 

1.359  x  10"2 

1.570  x  10"2 

3.161  x  10"2 

1.959  x  10“2 

Table  4:  Percent  of  confidence  ellipsoids  which  contain  the  true  parameter  values  (N=10). 


cr2  =  0.01 

cr2  =  0.05 

cr2  =  0.10 

SE- opt 

94.8%  (SE  =  0.70%) 

94.5%  (SE  =  0.72%) 

92.2%  (SE  =  0.85%) 

D-  opt 

94.7%  (SE  =  0.71%) 

93.3%  (SE  =  0.79%) 

88.3%  (SE  =  1.02%) 

U-opt 

91.2%  (SE  =  0.90%) 

82.7%  (SE  =  1.20%) 

76.7%  (SE  =  1.34%) 

Uniform 

94.4%  (SE  =  0.73%) 

89.7%  (SE  =  0.96%) 

89.0%  (SE  =  0.99%) 

4.3  Discussion  of  logistic  Monte  Carlo  results 

A  general  observation  from  these  results  is  that  as  the  measurement  noise  level  decreases,  variance 
in  the  parameters  ($sd)  decreases,  and  parameter  estimates  approach  the  true  parameter  values. 
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(a)  (b) 


(c) 

Figure  3:  Histograms  of  parameter  estimates  ( K  in  panel  (a),  f  in  panel  (b),  xq  in  panel  (c))  resulting 
from  Monte  Carlo  simulation  with  M  =  1000.  Different  histograms  within  each  subfigure  represent 
results  from  different  optimal  design  methods  as  well  as  from  the  uniform  mesh.  Simulated  data  was 
generated  with  N  =  10  and  1%  noise  (<7q  =  0.01). 

Comparing  the  standard  deviation  of  the  parameter  estimates  ($sd)  to  the  asymptotic  standard 
errors  ( SE(Q ))  we  find  that  they  are  always  on  the  same  order  of  magnitude,  and  often  the  asymptotic 
standard  errors  are  slightly  smaller  (more  optimistic). 

In  all  cases  the  average  parameter  estimates  were  very  close  to  the  true  values.  Comparing  the  optimal 
design  methods  based  on  the  standard  deviations  of  the  parameter  estimates,  we  find  different  results 
based  on  the  parameter.  For  parameter  K,  if-optimal  had  the  smallest  standard  deviation  in  every 
case,  followed  by  the  uniform  distribution.  For  parameters  r  and  xo,  S^-optimal  always  had  the 
smallest  standard  deviation,  often  followed  by  D-optimal.  Visually,  Fl-optimal  distributions  appear 
right-skewed  for  parameters  r  and  xo  for  <Tq  =  0.10,  and  N  =  10  and  N  =  15  (see  Figs.  5  and  8). 
Overall,  these  results  seem  to  be  in  agreement  with  the  comparative  performances  of  the  optimal 
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(a) 


(b) 


(c) 

Figure  4:  Histograms  of  parameter  estimates  ( K  in  panel  (a),  f  in  panel  (b),  xq  in  panel  (c))  resulting 
from  Monte  Carlo  simulation  with  M  =  1000.  Different  histograms  within  each  subfigure  represent 
results  from  different  optimal  design  methods  as  well  as  from  the  uniform  mesh.  Simulated  data  was 
generated  with  N  =  10  and  5%  noise  (<7q  =  0.05). 

design  methods  presented  in  [8]  where  we  used  for  comparison  only  asymptotic  standard  errors  based 
on  only  one  realization  of  the  observation  procedure. 

Examining  the  proportion  of  95%  confidence  ellipsoids  that  contain  the  true  parameter  value  (Tables  4 
and  8)  we  find  that  often  the  proportion  falls  short  of  the  expected  0.95,  especially  for  increased 
values  of  <7q.  Comparing  the  optimal  design  methods  based  on  which  has  the  best  coverage  of  the 
true  parameter  value,  we  find  that  S'E-optimal  is  the  best,  followed  by  D-optimal  or  the  uniform 
mesh,  with  E-optimal  being  the  least  desirable  design  method  for  this  logistic  example. 
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16.8  17  17.2  17.4  17.6  17.8  18 


(a) 


Estimates  of  r,  o^=0.10 


(b) 


(c) 

Figure  5:  Histograms  of  parameter  estimates  ( K  in  panel  (a),  f  in  panel  (b),  xq  in  panel  (c))  resulting 
from  Monte  Carlo  simulation  with  M  =  1000.  Different  histograms  within  each  subfigure  represent 
results  from  different  optimal  design  methods  as  well  as  from  the  uniform  mesh.  Simulated  data  was 
generated  with  N  =  10  and  10%  noise  (uq  =  0.10). 
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Table  5:  Average  estimates  0avg  and  corresponding  standard  deviations  #sd  from 
M  =  1000  Monte  Carlo  trials  as  well  as  asymptotic  standard  errors  SE(0). 


N  =  15,  <rg  =  0.01 

SE-  opt 

/4-opt 

U-opt 

Uniform 

ATavg 

17.5001 

17.4990 

17.4980 

17.5000 

A'sd 

3.747  x  10-2 

3.544  x  10”2 

2.914  x  10“2 

3.534  x  10~2 

SE(K) 

3.774  x  10-2 

3.612  x  10-2 

3.015  x  10"2 

3.537  x  10”2 

^avg 

0.7002 

0.7000 

0.7010 

0.7001 

rsD 

6.740  x  10-3 

8.543  x  10~3 

1.946  x  10~2 

9.622  x  10”3 

SE(r ) 

5.547  x  10-3 

6.862  x  10~3 

1.713  x  10“2 

8.088  x  10”3 

«^0,avg 

0.0999 

0.1002 

0.1001 

0.1002 

^0,SD 

4.895  x  10"3 

6.309  x  10”3 

1.197  x  10”2 

6.993  x  10'3 

SE(x0) 

3.524  x  10-3 

4.185  x  10”3 

7.560  x  10”3 

4.989  x  10~3 

Table  6:  Average  estimates  0avg  and  corresponding  standard  deviations  #sd  from 
M  =  1000  Monte  Carlo  trials  as  well  as  asymptotic  standard  errors  SE(0). 


N  =  15,  <Tq  =  0.05 

SE-opt 

/4-opt 

U-opt 

Uniform 

K 

^vavg 

17.4980 

17.5029 

17.4994 

17.5002 

A'sd 

8.612  x  10“2 

7.832  x  10~2 

6.850  x  10~2 

7.883  x  10~2 

SE(K) 

8.438  x  10“2 

8.077  x  10"2 

6.742  x  10~2 

7.910  x  10~2 

raVg 

0.7009 

0.7005 

0.7017 

0.7008 

fsD 

1.529  x  10-2 

1.966  x  10-2 

4.524  x  10“2 

2.250  x  10~2 

SE(f) 

1.240  x  10"2 

1.534  x  10~2 

3.831  x  10~2 

1.809  x  10”2 

^0,avg 

0.1000 

0.1006 

0.1028 

0.1007 

^0,SD 

1.120  x  10-2 

1.453  x  10~2 

2.757  x  10”2 

1.647  x  10”2 

SE(x  0) 

7.880  x  10"3 

9.357  x  10”3 

1.690  x  10~2 

1.116  x  10~2 
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Table  7:  Average  estimates  0avg  and  corresponding  standard  deviations  #sd  from 
M  =  1000  Monte  Carlo  trials  as  well  as  asymptotic  standard  errors  SE(0). 


N  =  15,  (7 2  =  0.1 

SB-opt 

H-opt 

T-opt 

Uniform 

K 

lv&vg 

17.4987 

17.5014 

17.5014 

17.5071 

Ksd 

1.192  x  10_1 

1.135  x  10"1 

9.545  x  10"2 

1.151  x  10”1 

SE(K) 

1.193  x  10_1 

1.142  x  10"1 

9.535  x  10"2 

1.119  x  10"1 

favg 

0.7011 

0.7017 

0.7046 

0.7010 

rSD 

2.070  x  10"2 

2.703  x  10~2 

6.565  x  10“2 

3.132  x  10"2 

SE(f) 

1.754  x  10"2 

2.170  x  10~2 

5.417  x  10”2 

2.558  x  10”2 

^0,avg 

0.1007 

0.1009 

0.1043 

0.1018 

^0,SD 

1.530  x  10"2 

2.026  x  10~2 

4.032  x  10”2 

2.317  x  10”2 

SE(x  0) 

1.114  x  10“2 

1.323  x  10~2 

2.391  x  10”2 

1.578  x  10-2 

Table  8:  Percent  of  confidence  ellipsoids  which  contain  the  true  parameter  values  (N=15). 


crl  =  0.01 

erg  =  0.05 

erg  =  0.10 

SE- opt 

95.7%  (SE  =  0.64%) 

94.0%  (SE  =  0.75%) 

93.5%  (SE  =  0.78%) 

H-opt 

95.1%  (SE  =  0.68%) 

92.3%  (SE  =  0.84%) 

89.2%  (SE  =  0.98%) 

E-  opt 

93.9%  (SE  =  0.76%) 

87.8%  (SE  =  1.04%) 

82.5%  (SE  =  1.20%) 

Uniform 

94.0%  (SE  =  0.75%) 

91.2%, (SB  =  0.90%) 

89.7%  (SE  =  0.96%) 
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(c) 

Figure  6:  Histograms  of  parameter  estimates  ( K  in  panel  (a),  f  in  panel  (b),  xq  in  panel  (c))  resulting 
from  Monte  Carlo  simulation  with  M  =  1000.  Different  histograms  within  each  subfigure  represent 
results  from  different  optimal  design  methods  as  well  as  from  the  uniform  mesh.  Simulated  data  was 
generated  with  N  =  15  and  1%  noise  (uq  =  0.01). 
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(c) 

Figure  7:  Histograms  of  parameter  estimates  ( K  in  panel  (a),  r  in  panel  (b),  xq  in  panel  (c))  resulting 
from  Monte  Carlo  simulation  with  M  =  1000.  Different  histograms  within  each  subfigure  represent 
results  from  different  optimal  design  methods  as  well  as  from  the  uniform  mesh.  Simulated  data  was 
generated  with  N  =  15  and  5%  noise  (<7q  =  0.05). 
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17.1  17.2  17.3  17.4  17.5  17.6  17.7  17.8  17.9  18 


(a) 


Estimates  of  r,  o^=0.10 


Estimates  of  xQ,  ojj=0.10 


(c) 

Figure  8:  Histograms  of  parameter  estimates  ( K  in  panel  (a),  r  in  panel  (b),  xq  in  panel  (c))  resulting 
from  Monte  Carlo  simulation  with  M  =  1000.  Different  histograms  within  each  subfigure  represent 
results  from  different  optimal  design  methods  as  well  as  from  the  uniform  mesh.  Simulated  data  was 
generated  with  N  =  15  and  10%  noise  (aft  =  0.10). 


17 


5  Harmonic  oscillator  results 


5.1  The  harmonic  oscillator 

Harmonic  oscillators  are  ubiquitous  in  science,  being  found  in  a  number  of  applications  ranging 
from  biology  (Lorentz  electromagnetic  polarization  laws  in  tissue),  electronic  circuits  and  mechanical 
devices.  The  model  for  the  harmonic  oscillator  can  be  easily  derived  (see  [10])  using  Hooke’s  Law 
and  Newton’s  Second  Law  of  Motion  and  is  given  with  out  external  forcing  by 

rnx  +  cx  +  kx  =  0,  x(0)  =  x\,  x(0)  =  aq. 

Here,  m  is  mass,  c  is  the  damping  coefficient,  and  k  is  the  spring  constant.  The  parameters  m,  c  and 
k  are  not  independent  for  the  unforced  oscillator.  Dividing  through  by  m,  and  defining  C  =  c/m 
and  K  =  k/m,  we  can  reduce  the  number  of  parameters  and  obtain 

x  +  Cx  +  Kx  =  0,  x(0)  =  xi,  x(0)  =  X2-  (5.1) 

The  analytical  solution  of  the  initial  value  problem  (5.1)  is  given  by 

x(t)  =  x{t ,  9)  =  e~at  ^X2  cos  bt  +  Xl  +  ax’2  g-n  ^  for  0  <  t  <  T, 

where  a  =  \C,  b  =  \J K  —  \C2.  For  the  following  investigations  we  fixed  the  initial  values  in  problem 
(5.1)  to  the  values  x\  =  —1,  aq  =  0.5.  The  parameter  vector  considered  is  6  =  (C,  K)T . 

For  our  Monte  Carlo  analysis  we  choose  the  nominal  parameter  vector 

00  =  (Cnom,  Knom)J  =  (0.1,0.2)T 

and  take  displacement  x(t,  9)  as  the  model  output  so  that 

fit, 9)  =  x(t,9),  t>  0. 

5.2  Monte  Carlo  analysis  for  the  harmonic  oscillator  model 

Monte  Carlo  analysis  was  conducted  using  the  optimal  design  points  computed  with  N  =  15,  T  = 
14.14  or  T  =  28.28,  and  the  four  different  implementations  (Cl)  -  (C4)  of  the  constraints  (see 
Figures  9  and  10).  For  each  optimal  mesh  or  the  uniform  mesh,  the  Monte  Carlo  analysis  was  repeated 
three  times  for  different  constant  variance  (<y2(t)  =  Uq  for  all  t)  noise  levels  Uq  =  (0.01,0.05,0.10). 
Figures  11-18  contain  histogram  plots  of  the  parameter  estimates  ( C,K ).  Each  figure  represents 
results  from  a  specific  constraint  implementation  and  a  value  of  T.  Each  subfigure  represents  one 
of  the  parameters  and  one  value  of  Oq.  Within  a  subfigure  are  histograms  corresponding  to  each 
optimal  design  method  (5'E-optimal,  D-optimal,  and  E-optimal)  and  the  uniform  mesh. 
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Optimal  mesh  with  N=15,  and  0  =  (C,K)  using  SolvOpt  algorithm.  Optimal  mesh  with  N=15,  and  0  =  (C,K)  using  SolvOpt  algorithm. 


Optimal  mesh  with  N=15,  and  0  =  (C,K)  using  SolvOpt  algorithm.  Optimal  mesh  with  N=15,  and  0  =  (C,K)  using  SolvOpt  algorithm. 


Figure  9:  Optimal  sampling  times  according  to  the  design  criteria  for  the  harmonic  oscillator.  Opti¬ 
mal  sampling  times  were  obtained  using  SolvOpt  with  N=15,  constraint  implementation  (Cl)  (upper 
panels)  respectively  (C2)  (lower  panels)  and  T  =  14.14  (left  panels)  respectively  T  =  28.28  (right 
panels) . 
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Optimal  mesh  with  N=15,  and  0  =  (C,K)  using  SolvOpt  algorithm.  Optimal  mesh  with  N=15,  and  0  =  (C,K)  using  SolvOpt  algorithm. 


Optimal  mesh  with  N=15,  and  0  =  (C,K)  using  SolvOpt  algorithm.  Optimal  mesh  with  N=15,  and  0  =  (C,K)  using  SolvOpt  algorithm. 


Figure  10:  Optimal  sampling  times  according  to  the  design  criteria  for  the  harmonic  oscillator. 
Optimal  sampling  times  were  obtained  using  SolvOpt  with  N=15,  constraint  implementation  (C3) 
(upper  panels)  respectively  (C4)  (lower  panels)  and  T  =  14.14  (left  panels)  respectively  T  =  28.28 
(right  panels). 
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Tables  9  -  11,  14  16,  19  -  21,  and  24  -  26  contain  the  average  estimates  and  standard  deviations 

from  the  Monte  Carlo  trials  for  the  four  constraints  respectively,  and  both  T  =  14.14  and  T  =  28.28, 
as  well  as  for  the  three  different  noise  levels.  In  addition,  the  tables  contain  the  asymptotic  standard 
errors  as  computed  in  (2.7)  using  the  true  parameter  values,  for  comparison  with  the  standard 
deviations  of  the  Monte  Carlo  parameter  estimates.  The  percentage  of  95%  confidence  ellipsoids 
which  contain  the  true  parameter  values  are  given  in  Tables  12,  13,  17,  18,  22,  23,  27,  and  28. 


Estimates  of  C,  c^=0.01  Estimates  of  K,  o^=0.01 


(e)  (f) 

Figure  11:  Histograms  of  parameter  estimates  ( C  in  panels  (a),(c),(e),  and  K  in  panels  (b),(d),(f)) 
resulting  from  Monte  Carlo  simulation.  Simulated  data  was  generated  with  (7q  =  0.01  (top  row), 
Ug  =  0.05  (middle  row),  and  (7q  =  0.10  (bottom  row)  (T  =  14.14  and  constraint  implementation 
(Cl)). 
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Table  9:  Average  estimates  0avg  with  corresponding  standard  deviations  $sd  from 
M  =  1000  Monte  Carlo  trials  as  well  as  asymptotic  standard  errors  SE{9). 
Estimation  with  constraint  implementation  (Cl). 


N  =  15,  o-g  =  0.01 

T  =  14.14 

SE-  opt 

E-opt 

E-opt 

Uniform 

Cavg 

0.0998 

0.0999 

0.0999 

0.1002 

Csd 

5.197  x  10“3 

4.904  x  10“3 

5.928  x  10~3 

6.495  x  10-3 

SE(C ) 

5.004  x  10~3 

4.746  x  10~3 

5.818  x  10“3 

6.577  x  10"3 

K 

1  Yavg 

0.2002 

0.2001 

0.2000 

0.2000 

A'sd 

4.049  x  10-3 

2.360  x  10~3 

3.482  x  10~3 

2.977  x  10-3 

SE(K) 

3.678  x  10“3 

2.378  x  10~3 

3.416  x  10”3 

2.895  x  10“3 

T  =  28.28 

Cavg 

0.1000 

0.0999 

0.0999 

0.1000 

Csd 

4.493  x  10“3 

4.319  x  10"3 

5.707  x  10~3 

5.123  x  10-3 

SE(C) 

4.342  x  10~3 

4.284  x  10~3 

5.214  x  10~3 

5.127  x  10“3 

K 

-£Yavg 

0.2002 

0.2000 

0.2002 

0.2000 

A'sd 

3.238  x  10~3 

1.854  x  10”3 

3.981  x  10~3 

2.413  x  10-3 

SE{K) 

3.021  x  10~3 

1.994  x  10“3 

3.412  x  10~3 

2.307  x  10“3 

Table  10:  Average  estimates  0avg  with  corresponding  standard  deviations  $sd  from 
M  =  1000  Monte  Carlo  trials  as  well  as  asymptotic  standard  errors  SE(9). 
Estimation  with  constraint  implementation  (Cl). 


N  =  15,  <rg  =  0.05 

T  =  14.14 

SE-  opt 

E-opt 

E-opt 

Uniform 

Cavg 

0.0999 

0.1008 

0.0994 

0.0994 

Csd 

1.145  x  10“2 

1.019  x  10~2 

1.286  x  10~2 

1.457  x  10-2 

SE{C ) 

1.119  x  10”2 

1.061  x  10”2 

1.301  x  10”2 

1.471  x  10“2 

K 

^'-avg 

0.2008 

0.2000 

0.2001 

0.2001 

Esd 

8.782  x  10"3 

5.430  x  10-3 

7.761  x  10”3 

6.469  x  10-3 

SE(K) 

8.224  x  10"3 

5.318  x  10"3 

7.640  x  10~3 

6.473  x  10-3 

T  =  28.28 

C^avg 

0.0996 

0.0997 

0.0988 

0.1001 

Csd 

9.659  x  10-3 

9.588  x  10“3 

1.224  x  10~2 

1.183  x  10-2 

SE(C ) 

9.708  x  10~3 

9.579  x  10“3 

1.166  x  10"2 

1.146  x  10“2 

Aiavg 

0.2004 

0.2000 

0.2013 

0.2001 

KsD 

7.795  x  10"3 

4.295  x  10-3 

1.129  x  10~2 

5.114  x  10-3 

SE(K) 

6.755  x  10~3 

4.459  x  10"3 

7.629  x  10"3 

5.159  x  10“3 
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Table  11:  Average  estimates  0avg  with  corresponding  standard  deviations  <?sd  from 
M  =  1000  Monte  Carlo  trials  as  well  as  asymptotic  standard  errors  SE(9). 
Estimation  with  constraint  implementation  (Cl). 


N  =  15,  tr2  =  0.1 

T  =  14.14 

SE-  opt 

H-opt 

E-opt 

Uniform 

Cavg 

0.0999 

0.1003 

0.0991 

0.1008 

C'sD 

1.621  x  10“2 

1.445  x  10~2 

1.842  x  10~2 

2.107  x  10"2 

SE(C) 

1.582  x  10“2 

1.501  x  10“2 

1.840  x  10~2 

2.080  x  10"2 

K 

-£Yavg 

0.2008 

0.2002 

0.2007 

0.2000 

A'sd 

1.286  x  10”2 

7.447  x  10"3 

1.131  x  10~2 

9.192  x  10"3 

SE(K) 

1.163  x  10”2 

7.521  x  10~3 

1.080  x  10~2 

9.154  x  10“3 

T  =  28.28 

Cavg 

0.0991 

0.0998 

0.0978 

0.0992 

C'SD 

1.386  x  10"2 

1.353  x  10~2 

1.714  x  10~2 

1.628  x  10"2 

SE(C) 

1.373  x  10~2 

1.355  x  10~2 

1.649  x  10-2 

1.621  x  10"2 

K 

iya,vg 

0.2015 

0.2003 

0.2038 

0.2001 

Ksd 

1.106  x  10~2 

6.602  x  10“3 

1.807  x  10"2 

7.350  x  10“3 

SE{K) 

9.553  x  10~3 

6.305  x  10“3 

1.079  x  10~2 

7.295  x  10“3 

Table  12:  Percent  of  confidence  ellipsoids  which  contain  the  true  parameter  values 
(T  =  14.14,  constraint  implementation  (Cl)). 


a'l  =  0.01 

erg  =  0.05 

erg  =  0.10 

SE-  opt 

95.9%  (SE  =  0.63%) 

94.7%  (SE  =  0.71%) 

94.3%  (SE  =  0.73%) 

H-opt 

95.2%  (SE  =  0.68%) 

96.7%  (SE  =  0.56%) 

95.9%  (SE  =  0.63%) 

E-opt 

95.5%  (SE  =  0.66%) 

94.4%  (SE  =  0.73%) 

94.6%  (SE  =  0.71%) 

Uniform 

94.6%  (SE  =  0.71%) 

95.2%  (SE  =  0.68%) 

95.4%  (SE  =  0.66%) 

Table  13:  Percent  of  confidence  ellipsoids  which  contain  the  true  parameter  values 
(T  =  28.28,  constraint  implementation  (Cl)). 


erg  =  0.01 

ug  =  0.05 

erg  =  0.10 

SE- opt 

95.5%  (SE  =  0.66%) 

92.6%  (SE  =  0.83%) 

93.2%  (SE  =  0.80%) 

ZUopt 

95.7%  (SE  =  0.64%) 

95.1%  (SE  =  0.68%) 

93.1%  (SE  =  0.80%) 

E-opt 

94.9%  (SE  =  0.70%) 

92.8%  (SE  =  0.82%) 

90.5%  (SE  =  0.93%) 

Uniform 

95.3%  (SE  =  0.67%) 

94.2%  (SE  =  0.74%) 

93.3%  (SE  =  0.79%) 

23 


Estimates  of  C,  <^=0.01  Estimates  of  K,  o^=0.01 


0.08  0.085  0.09  0.095  0.1  0.105  0.11  0.115  0.12  0.19  0.195  0.2  0.205  0.21  0.215 


(e)  (f) 

Figure  12:  Histograms  of  parameter  estimates  ( C  in  panels  (a),(c),(e),  and  K  in  panels  (b),(d),(f)) 
resulting  from  Monte  Carlo  simulation.  Simulated  data  was  generated  with  Uq  =  0.01  (top  row), 
<7q  =  0.05  (middle  row),  and  Uq  =  0.10  (bottom  row)  (T  =  28.28  and  constraint  implementation 
(Cl)). 
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(a) 


(b) 


(c) 


(d) 


(e)  (f) 

Figure  13:  Histograms  of  parameter  estimates  ( C  in  panels  (a),(c),(e),  and  K  in  panels  (b),(d),(f)) 
resulting  from  Monte  Carlo  simulation.  Simulated  data  was  generated  with  Uq  =  0.01  (top  row), 
<7q  =  0.05  (middle  row),  and  Uq  =  0.10  (bottom  row)  (T  =  14.14  and  constraint  implementation 
(C2)). 
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Table  14:  Average  estimates  0avg  with  corresponding  standard  deviations  $sd  from 
M  =  1000  Monte  Carlo  trials  as  well  as  asymptotic  standard  errors  SE(8). 
Estimation  based  on  constraint  implementation  (C2). 


N  =  15,  er2  =  0.01 

T  =  14.14 

SE-  opt 

E-opt 

E-opt 

Uniform 

Cavg 

0.1000 

0.1000 

0.0998 

0.0998 

C'SD 

5.264  x  10"3 

5.261  x  10”3 

5.536  x  10~3 

6.431  x  10“3 

SE(C) 

5.444  x  10~3 

4.987  x  10~3 

5.700  x  10^3 

6.577  x  10"3 

K 

-*vavg 

0.2002 

0.2000 

0.2002 

0.2000 

A'sd 

3.424  x  10~3 

2.211  x  10"3 

3.112  x  10~3 

2.867  x  10“3 

SE(K) 

3.344  x  10~3 

2.181  x  10"3 

3.008  x  10'3 

2.895  x  10“3 

T  =  28.28 

Cavg 

0.0999 

0.0998 

0.0998 

0.1001 

C'SD 

4.741  x  10"3 

4.630  x  10”3 

5.454  x  10”3 

5.342  x  10“3 

SE(C) 

4.537  x  10“3 

4.528  x  10“3 

5.279  x  10~3 

5.127  x  10-3 

K 

-^avg 

0.2001 

0.2000 

0.2000 

0.2000 

Ksd 

3.414  x  10~3 

2.202  x  10~3 

3.509  x  10“3 

2.285  x  10“3 

SE{K) 

3.144  x  10~3 

2.137  x  10“3 

3.260  x  10“3 

2.307  x  10“3 

Table  15:  Average  estimates  0avg  with  corresponding  standard  deviations  $sd  from 
M  =  1000  Monte  Carlo  trials  as  well  as  asymptotic  standard  errors  SE(9). 
Estimation  based  on  constraint  implementation  (C2). 


N  =  15,  <rjj  =  0.05 

T  =  14.14 

SE-  opt 

E-opt 

E-opt 

Uniform 

C^avg 

0.0996 

0.0997 

0.0999 

0.1005 

C'SD 

1.247  x  10-2 

1.125  x  10~2 

1.238  x  10~2 

1.564  x  10-2 

SE{C ) 

1.217  x  10“2 

1.115  x  10-2 

1.275  x  10-2 

1.471  x  10-2 

K 

1  Yavg 

0.2002 

0.1997 

0.1999 

0.2002 

Ksd 

7.715  x  10”3 

5.107  x  10"3 

6.751  x  10”3 

6.549  x  10“3 

SE{K) 

7.477  x  10”3 

4.876  x  10-3 

6.727  x  10”3 

6.473  x  10-3 

T  =  28.28 

C^avg 

0.0990 

0.0997 

0.0998 

0.1007 

C'SD 

1.008  x  10-2 

9.940  x  10~3 

1.172  x  10~2 

1.153  x  10-2 

SE(C ) 

1.015  x  10-2 

1.012  x  10-2 

1.180  x  10~2 

1.146  x  10-2 

K 

0.2006 

0.2000 

0.2009 

0.2000 

kSD 

7.797  x  10~3 

4.753  x  10“3 

8.777  x  10~3 

5.443  x  10“3 

SE(K) 

7.030  x  10“3 

4.778  x  10“3 

7.289  x  10“3 

5.159  x  10-3 
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Table  16:  Average  estimates  0avg  with  corresponding  standard  deviations  <?sd  from 
M  =  1000  Monte  Carlo  trials  as  well  as  asymptotic  standard  errors  SE(9). 
Estimation  based  on  constraint  implementation  (C2). 


N  =  15,  <rjj  =  0.1 

T  =  14.14 

SE-  opt 

D-opt 

E-opt 

Uniform 

Cavg 

0.0988 

0.1002 

0.1003 

0.1014 

C'sD 

1.703  x  10~2 

1.492  x  10~2 

1.863  x  10~2 

2.138  x  10“2 

SE(C) 

1.721  x  10~2 

1.577  x  10~2 

1.802  x  10~2 

2.080  x  10“2 

K 

-^avg 

0.1998 

0.1997 

0.2004 

0.2000 

A'sd 

1.073  x  10~2 

6.885  x  10'3 

9.921  x  10“3 

9.483  x  10“3 

SE(li) 

1.057  x  10~2 

6.895  x  10'3 

9.513  x  10“3 

9.154  x  10“3 

T  =  28.28 

Cavg 

0.0990 

0.0997 

0.0998 

0.1007 

C'SD 

1.008  x  10~2 

9.940  x  10"3 

1.172  x  10”2 

1.153  x  10“2 

SE(C) 

1.015  x  10~2 

1.012  x  10“2 

1.180  x  10-2 

1.146  x  10"2 

K 

-^avg 

0.2006 

0.2000 

0.2009 

0.2000 

Ksd 

7.797  x  10“3 

4.753  x  10”3 

8.777  x  10“3 

5.443  x  10“3 

SE(li) 

7.030  x  10~3 

4.778  x  10”3 

7.289  x  10”3 

5.159  x  10~3 

Table  17:  Percent  of  confidence  ellipsoids  which  contain  the  true  parameter  values 
(T  =  14.14,  constraint  implementation  (C2)). 


erg  =  0.01 

erg  =  0.05 

erg  =  0.10 

SE- opt 

95.5%  (SE  =  0.66%) 

93.9%  (SE  =  0.76%) 

94.3%  (SE  =  0.73%) 

H-opt 

95.3%  (SE  =  0.67%) 

93.7%  (SE  =  0.77%) 

95.5%  (SE  =  0.66%) 

T-opt 

94.6%  (SE  =  0.71%) 

94.9%  (SE  =  0.70%) 

94.0%  (SE  =  0.75%) 

Uniform 

95.1%  (SE  =  0.68%) 

95.1%  (SE  =  0.68%) 

94.5%  (SE  =  0.72%) 

Table  18:  Percent  of  confidence  ellipsoids  which  contain  the  true  parameter  values 
(T  =  28.28,  constraint  implementation  (C2)). 


erg  =  0.01 

ug  =  0.05 

erg  =  0.10 

SE- opt 

94.6%  (SE  =  0.71%) 

93.4%  (SE  =  0.79%) 

93.1%  (SE  =  0.80%) 

ZUopt 

93.7%  (SE  =  0.77%) 

95.0%  (SE  =  0.69%) 

92.3%  (SE  =  0.84%) 

E-opt 

93.0%  (SE  =  0.81%) 

92.7%  (SE  =  0.82%) 

92.4%  (SE  =  0.84%) 

Uniform 

94.6%  (SE  =  0.71%) 

94.9%  (SE  =  0.70%) 

95.2%  (SE  =  0.68%) 
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Estimates  of  C,  <^=0.01 


0.08  0.085  0.09  0.095  0.1  0.105  0.11  0.115  0.12 


Estimates  of  K,  o^=0.01 


(b) 

Estimates  of  K,  <^=0.05 


(d) 


Estimates  of  K,  c^=0.10 


7  in  panels  (a),(c),(e),  and  K  in  panels  (b),(d),(f)) 
;ed  data  was  generated  with  ctq  =  0.01  (top  row), 
a  row)  (T  =  28.28  and  constraint  implementation 
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(a) 


(b) 


(c) 


(d) 


(e)  (f) 

Figure  15:  Histograms  of  parameter  estimates  ( C  in  panels  (a),(c),(e),  and  K  in  panels  (b),(d),(f)) 
resulting  from  Monte  Carlo  simulation.  Simulated  data  was  generated  with  Uq  =  0.01  (top  row), 
Oq  =  0.05  (middle  row),  and  Oq  =  0.10  (bottom  row)  (T  =  14.14  and  constraint  implementation 
(C3)). 
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Table  19:  Average  estimates  0avg  with  corresponding  standard  deviations  $sd  from 
M  =  1000  Monte  Carlo  trials  as  well  as  asymptotic  standard  errors  SE(8). 
Estimation  based  on  constraint  implementation  (C3). 


N  =  15,  o-jj  =  0.01 

T  =  14.14 

SE-  opt 

E-opt 

E-opt 

Uniform 

Cavg 

0.1002 

0.1002 

0.1003 

0.0999 

C'SD 

5.396  x  10”3 

4.957  x  10”3 

6.616  x  10"3 

6.664  x  10“3 

SE(C) 

5.124  x  10”3 

4.938  x  10~3 

6.361  x  10”3 

6.577  x  10“3 

K 

-*Yavg 

0.2002 

0.2000 

0.2002 

0.2000 

Ksd 

3.888  x  10~3 

2.318  x  10~3 

4.770  x  10~3 

2.888  x  10"3 

SE(K) 

3.735  x  10~3 

2.248  x  10~3 

4.162  x  10~3 

2.895  x  10“3 

T  =  28.28 

Cavg 

0.0999 

0.0999 

0.1002 

0.1000 

C'SD 

4.785  x  10~3 

4.398  x  10“3 

5.593  x  10~3 

5.147  x  10“3 

SE(C) 

4.492  x  10“3 

4.372  x  10“3 

5.409  x  10“3 

5.127  x  10-3 

K 

-£Vavg 

0.2001 

0.1999 

0.2005 

0.1999 

A'sd 

3.325  x  10"3 

2.027  x  10~3 

4.067  x  10“3 

2.317  x  10"3 

SE(K) 

3.088  x  10~3 

2.005  x  10~3 

3.539  x  10~3 

2.307  x  10"3 

Table  20:  Average  estimates  0avg  with  corresponding  standard  deviations  $sd  from 
M  =  1000  Monte  Carlo  trials  as  well  as  asymptotic  standard  errors  SE(9). 
Estimation  based  on  constraint  implementation  (C3). 


N  =  15,  <rjj  =  0.05 

T  =  14.14 

SE-  opt 

E-opt 

E-opt 

Uniform 

C^avg 

0.0997 

0.1001 

0.1008 

0.0996 

C'SD 

1.185  x  10-2 

1.082  x  10-2 

1.451  x  10~2 

1.474  x  10-2 

SE{C ) 

1.146  x  10-2 

1.104  x  10-2 

1.422  x  10~2 

1.471  x  10-2 

K 

0.2007 

0.2002 

0.2014 

0.2000 

Ksd 

9.063  x  10”3 

4.951  x  10~3 

1.089  x  10~2 

6.885  x  10“3 

SE(K) 

8.351  x  10“3 

5.028  x  10-3 

9.307  x  10”3 

6.473  x  10-3 

T  =  28.28 

C^avg 

0.0993 

0.1000 

0.0991 

0.0992 

C'SD 

1.010  x  10-2 

9.973  x  10~3 

1.313  x  10~2 

1.147  x  10-2 

SE(C ) 

1.005  x  10-2 

9.775  x  10-3 

1.209  x  10“2 

1.146  x  10-2 

K 

lvaxg 

0.2006 

0.2001 

0.2027 

0.2003 

Ksd 

7.581  x  10~3 

4.465  x  10“3 

1.433  x  10~2 

5.200  x  10“3 

SE(K) 

6.905  x  10“3 

4.484  x  10“3 

7.913  x  10"3 

5.159  x  10-3 
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Table  21:  Average  estimates  9avg  with  corresponding  standard  deviations  $sd  from 
M  =  1000  Monte  Carlo  trials  as  well  as  asymptotic  standard  errors  SE(8). 
Estimation  based  on  constraint  implementation  (C3). 


N  =  15,  ct2  =  0.1 

T  =  14.14 

SE-opt 

H-opt 

E-opt 

Uniform 

Cavg 

0.1002 

0.1001 

0.0995 

0.0988 

CsD 

1.736  x  10"2 

1.603  x  10-2 

2.028  x  10"2 

2.074  x  10-2 

SE(C) 

1.620  x  10“2 

1.562  x  10"2 

2.012  x  10~2 

2.080  x  10“2 

K&vg 

0.2012 

0.2001 

0.2021 

0.2004 

Ks  D 

1.310  x  10~2 

7.205  x  10”3 

1.665  x  10~2 

9.417  x  10-3 

SE(K) 

1.181  x  10“2 

7.110  x  10~3 

1.316  x  10~2 

9.154  x  10-3 

T  =  28.28 

Cavg 

0.0989 

0.1001 

0.0968 

0.1007 

C*SD 

1.448  x  10-2 

1.372  x  10-2 

1.743  x  10~2 

1.730  x  10“2 

SE(C) 

1.421  x  10”2 

1.382  x  10~2 

1.710  x  10~2 

1.621  x  10“2 

Aavg 

0.2019 

0.2002 

0.2056 

0.2002 

Ks  D 

1.218  x  10“2 

6.432  x  10"3 

2.156  x  10'2 

7.437  x  10-3 

SE(K) 

9.765  x  10~3 

6.341  x  10~3 

1.119  x  10~2 

7.295  x  10-3 
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Table  22:  Percent  of  confidence  ellipsoids  which  contain  the  true  parameter  values 
(T  =  14.14,  constraint  implementation  (C3)). 


erg  =  0.01 

erg  =  0.05 

erg  =  0.10 

SE- opt 

94.7%  (SE  =  0.71%) 

94.9%  (SE  =  0.70%) 

93.5%  (SE  =  0.78%) 

D-opt 

93.9%  (SE  =  0.76%) 

95.1%  (SE  =  0.68%) 

95.1%  (SE  =  0.68%) 

E-opt 

94.9%  (SE  =  0.70%) 

93.8%  (SE  =  0.76%) 

92.1%  (SE  =  0.85%) 

Uniform 

94.3%  (SE  =  0.73%) 

93.7%  (SE  =  0.77%) 

95.6%  (SE  =  0.65%) 

Table  23:  Percent  of  confidence  ellipsoids  which  contain  the  true  parameter  values 
(T  =  28.28,  constraint  implementation  (C3)). 


erg  =  0.01 

ug  =  0.05 

erg  =  0.10 

SE- opt 

93.9%  (SE  =  0.76%) 

94.6%  (SE  =  0.71%) 

93.3%  (SE  =  0.79%) 

D-opt 

94.4%  (SE  =  0.73%) 

94.7%  (SE  =  0.71%) 

94.6%  (SE  =  0.71%) 

E-opt 

95.3%  (SE  =  0.67%) 

91.1%  (SE  =  0.90%) 

86.5%  (SE  =  1.08%) 

Uniform 

94.7%  (SE  =  0.71%) 

95.3%  (SE  =  0.67%) 

93.9%  (SE  =  0.76%) 

Table  24:  Average  estimates  0avg  with  corresponding  standard  deviations  $sd  from 
M  =  1000  Monte  Carlo  trials  as  well  as  asymptotic  standard  errors  SE(8). 
Estimation  based  on  constraint  implementation  (C4). 


N  =  15,  erg  =  0.01 

T  =  14.14 

SE-  opt 

H-opt 

U-opt 

Uniform 

Cavg 

0.0999 

0.1003 

0.0998 

0.0998 

CsD 

5.235  x  10“3 

5.136  x  10“3 

6.716  x  10~3 

6.532  x  10-3 

SE(C) 

5.124  x  10~3 

5.108  x  10“3 

6.361  x  10“3 

6.577  x  10-3 

K 

JVavg 

0.2001 

0.2000 

0.2000 

0.2001 

Ks  D 

4.010  x  10-3 

2.289  x  10~3 

4.426  x  10~3 

2.926  x  10-3 

SE(K) 

3.735  x  10"3 

2.295  x  10~3 

4.162  x  10~3 

2.895  x  10-3 

T  =  28.28 

Cavg 

0.0999 

0.1001 

0.1001 

0.1000 

CsD 

4.434  x  10“3 

4.303  x  10-3 

5.596  x  10~3 

4.906  x  10-3 

SE(C) 

4.504  x  10“3 

4.391  x  10~3 

5.419  x  10”3 

5.127  x  10-3 

K 

iy&vg 

0.2001 

0.1998 

0.2002 

0.1999 

Ks  D 

3.354  x  10-3 

1.989  x  10"3 

3.924  x  10~3 

2.371  x  10-3 

SE(K ) 

3.116  x  10-3 

2.003  x  10-3 

3.546  x  10~3 

2.307  x  10-3 
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(a)  (b) 


(c) 


(d) 


(e)  (f) 

Figure  16:  Histograms  of  parameter  estimates  ( C  in  panels  (a),(c),(e),  and  K  in  panel  (b),(d),(f)) 
resulting  from  Monte  Carlo  simulation.  Simulated  data  was  generated  with  ctq  =  0.01  (top  row), 
Oq  =  0.05  (middle  row),  and  Oq  =  0.10  (bottom  row)  (T  =  28.28  and  constraint  implementation 
(C3)). 

5.3  Discussion  of  Harmonic  Oscillator  Monte  Carlo  Results 

From  the  harmonic  oscillator  Monte  Carlo  results  we  again  observe  that  as  the  level  of  noise  in  the 
data  decreases  so  does  the  variance  in  the  parameter  estimates  ($sd)  and  the  estimates  approach 
the  true  values.  Examining  the  average  parameter  estimates,  we  find  that  in  all  cases  the  averages 
are  close  to  the  true  values  0$  =  (Cnom.  Knom)J  =  (0.1,0.2)T.  However  in  Figures  11  -  18  often  it 
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(a) 


(b) 


(c) 


(d) 


(e)  (f) 

Figure  17:  Histograms  of  parameter  estimates  ( C  in  panels  (a),(c),(e),  and  K  in  panels  (b),(d),(f)) 
resulting  from  Monte  Carlo  simulation.  Simulated  data  was  generated  with  Uq  =  0.01  (top  row), 
Oq  =  0.05  (middle  row),  and  Oq  =  0.10  (bottom  row)  (T  =  14.14  and  constraint  implementation 
(C4)). 


appears  as  though  for  noise  levels  <7q  =  0.05  and  0.10,  17-optimal  and  Sill-optimal  distributions  are 
right-skewed  for  the  parameter  K.  Also,  often  17-optimal  distributions  appear  to  be  left-skewed  for 
parameter  C  for  the  higher  levels  of  noise  in  the  data.  This  causes  the  average  estimates  of  K  to  be 
slightly  larger  than  the  true  value  for  Fl-optimal  and  SiH-optimal,  and  the  average  estimate  of  C  to 
be  slightly  smaller  than  the  true  value  for  Fl-optimal. 

Comparing  the  standard  deviations  of  the  parameter  estimates  $sd  to  the  asymptotic  standard 
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Table  25:  Average  estimates  9avg  with  corresponding  standard  deviations  $sd  from 
M  =  1000  Monte  Carlo  trials  as  well  as  asymptotic  standard  errors  SE(8). 
Estimation  based  on  constraint  implementation  (C4). 


N  =  15,  o-g  =  0.05 

T  =  14.14 

SE-  opt 

H-opt 

F-opt 

Uniform 

Cavg 

0.0994 

0.1004 

0.1000 

0.1004 

C'SD 

1.172  x  10"2 

1.196  x  10-2 

1.498  x  10~2 

1.459  x  10-2 

SE(C) 

1.146  x  10“2 

1.142  x  10~2 

1.422  x  10~2 

1.471  x  10"2 

ATavg 

0.2006 

0.2000 

0.2011 

0.1996 

KS  D 

9.001  x  10-3 

5.172  x  10-3 

1.100  x  10~2 

6.683  x  10-3 

SE(K ) 

8.351  x  10-3 

5.133  x  10~3 

9.307  x  10~3 

6.473  x  10-3 

T  =  28.28 

Cavg 

0.0997 

0.0997 

0.0991 

0.1000 

C'SD 

9.840  x  10-3 

1.019  x  10”2 

1.299  x  10"2 

1.147  x  10-2 

SE(C ) 

1.007  x  10"2 

9.820  x  10“3 

1.212  x  10~2 

1.146  x  10"2 

ATavg 

0.2007 

0.2000 

0.2022 

0.1999 

Ksd 

7.336  x  10"3 

4.351  x  10~3 

1.268  x  10~2 

5.005  x  10-3 

SE(K) 

6.967  x  10-3 

4.478  x  10~3 

7.928  x  10~3 

5.159  x  10-3 

errors  SE(9)  we  find  that  they  are  very  close  in  every  case.  Comparing  the  standard  deviations  of 
the  parameter  estimates  among  the  optimal  design  methods  and  the  uniform  mesh  often  we  find 
that  D-optimal  had  the  smallest  standard  deviations,  followed  by  5'E-optimal  for  parameter  C  and 
the  uniform  mesh  for  parameter  K.  In  Tables  14  -  16  for  T  =  28.28,  and  24  -  26  H-optimal  and 
S'E-optimal  had  the  smallest  standard  deviations  for  the  parameter  C.  For  parameter  K,  F-optimal 
had  the  smallest  standard  deviation  again  followed  by  the  uniform  mesh. 

For  the  harmonic  oscillator  example  95%  confidence  ellipsoid  coverage  of  the  true  parameter  value 
is  better  overall  than  in  the  logistic  example.  This  may  not  be  a  reasonable  comparison  since  only 
p  =  2  parameters  are  estimated  for  the  harmonic  oscillator  example,  whereas  in  the  logistic  example 
p  =  3.  In  this  example,  no  optimal  design  mesh  is  consistently  better  in  terms  of  confidence  ellipsoid 
coverage  of  the  true  parameter  value.  However,  in  almost  every  case  F-optimal  has  the  worst  coverage 
compared  to  the  other  optimal  design  methods  (though  still  being  fairy  decent). 
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Table  26:  Average  estimates  0avg  with  corresponding  standard  deviations  <?sd  from 
M  =  1000  Monte  Carlo  trials  as  well  as  asymptotic  standard  errors  SE(9). 
Estimation  based  on  constraint  implementation  (C4). 


N  =  15,  <rg  =  0.1 

T  =  14.14 

SE-  opt 

D-opt 

E-opt 

Uniform 

Cavg 

0.0992 

0.1002 

0.0996 

0.1013 

C'sD 

1.635  x  10“2 

1.691  x  10~2 

2.099  x  10~2 

2.089  x  10"2 

SE(C) 

1.621  x  10”2 

1.615  x  10“2 

2.012  x  10~2 

2.080  x  10"2 

K 

-£Yavg 

0.2013 

0.2000 

0.2020 

0.1994 

A'sd 

1.326  x  10”2 

7.446  x  10"3 

1.611  x  10”2 

9.633  x  10"3 

SE(K) 

1.181  x  10”2 

7.259  x  10~3 

1.316  x  10~2 

9.154  x  10“3 

T  =  28.28 

Cavg 

0.0991 

0.1004 

0.0979 

0.0995 

C'SD 

1.404  x  10"2 

1.377  x  10~2 

1.752  x  10~2 

1.579  x  10"2 

SE(C) 

1.424  x  10~2 

1.389  x  10"2 

1.714  x  10-2 

1.621  x  10"2 

K 

Jya,vg 

0.2012 

0.2002 

0.2046 

0.2000 

Ksd 

1.168  x  10~2 

6.757  x  10“3 

1.960  x  10"2 

7.242  x  10“3 

SE{K) 

9.853  x  10“3 

6.333  x  10“3 

1.121  x  10~2 

7.295  x  10“3 

Table  27:  Percent  of  confidence  ellipsoids  which  contain  the  true  parameter  values 
(T  =  14.14,  constraint  implementation  (C4)). 


erg  =  0.01 

erg  =  0.05 

erg  =  0.10 

SE- opt 

94.6%  (SE  =  0.71%) 

93.9%  (SE  =  0.76%) 

95.5%  (SE  =  0.66%) 

H-opt 

94.8%  (SE  =  0.70%) 

94.4%  (SE  =  0.73%) 

94.3%  (SE  =  0.73%) 

T-opt 

94.6%  (SE  =  0.71%) 

94.0%  (SE  =  0.75%) 

93.1%  (SE  =  0.80%) 

Uniform 

95.2%  (SE  =  0.68%) 

96.3%  (SE  =  0.60%) 

94.5%  (SE  =  0.72%) 

Table  28:  Percent  of  confidence  ellipsoids  which  contain  the  true  parameter  values 
(T  =  28.28,  constraint  implementation  (C4)). 


erg  =  0.01 

ug  =  0.05 

erg  =  0.10 

SE- opt 

94.9%  (SE  =  0.70%) 

94.4%  (SE  =  0.73%) 

93.9%  (SE  =  0.76%) 

ZUopt 

94.2%  (SE  =  0.74%) 

94.4%  (SE  =  0.73%) 

95.0%  (SE  =  0.70%) 

E-opt 

94.7%  (SE  =  0.71%) 

92.5%  (SE  =  0.83%) 

89.9%  (SE  =  0.95%) 

Uniform 

96.2%  (SE  =  0.60%) 

94.9%  (SE  =  0.70%) 

94.7%  (SE  =  0.71%) 
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(a) 


(b) 


(c) 


(d) 


(e)  (f) 

Figure  18:  Histograms  of  parameter  estimates  ( C  in  panels  (a),(c),(e),  and  K  in  panels  (b),(d),(f)) 
resulting  from  Monte  Carlo  simulations.  Simulated  data  was  generated  with  <7q  =  0.01  (top  row), 
<7q  =  0.05  (middle  row),  and  Uq  =  0.10  (bottom  row)  (T  =  28.28  and  constraint  implementation 
(C4)). 
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6  Concluding  Remarks 


We  have  considered  the  performance  of  three  optimal  design  criteria  based  on  the  Fisher  Information 
Matrix,  the  SE-optimal,  D-optimal  and  E-optimal  design  methods  on  two  popular  examples,  the 
logistic  growth  model  and  the  harmonic  oscillator.  We  use  Monte  Carlo  simulations  with  M  =  1000 
to  compare  standard  errors  for  estimated  parameters  with  each  method.  The  recently  introduced 
[8]  SE-optimal  design  is  quite  competitive  with  and  in  some  cases  superior  to  the  more  traditional 
D-optimal  and  E-optimal  design  methods.  In  summary,  the  results  found  and  reported  here  are 
fully  consistent  with  those  given  in  [8]  where  the  analysis  is  based  on  asymptotic  standard  errors 
computed  with  a  single  realization. 
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